Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support changing the S3 Endpoint #523

Merged
merged 2 commits into from
Nov 9, 2022

Conversation

omad
Copy link
Member

@omad omad commented Nov 9, 2022

There are multiple tests failing at the moment that this PR does not address. They are due to external changes changes in the Sentinel-2 STAC metadata.

This PR adds support for changing the S3 Endpoint to be used, by setting the environment variable AWS_S3_ENDPOINT. This will allow changing the tests to use a local moto server instead of relying on external data sources for tests, which have changed and broken tests, and are liable to do so again in the future.

See #470 and #521.

Closes: #470

@omad
Copy link
Member Author

omad commented Nov 9, 2022

There's also loads of linting and pre-commit checks that are failing, since they've never been enabled or enforced. I tried fixing them here, but it was getting out of hand, so I'm going to merge and fix later.

The failing checkers are

  • yamllint (when run via pre-commit it doesn't use the config file in this repo)
  • flake8
  • pylint

@omad omad merged commit ee6aa07 into opendatacube:develop Nov 9, 2022
@omad omad deleted the allow-overriding-s3-endpoint branch November 9, 2022 00:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

AWS_S3_ENDPOINT env for s3-to-dc
1 participant